Tactile touch sensor system and method

ABSTRACT

A tactile touch sensor (TTS) system and method allowing physical augmentation of a high-resolution touch sensor array (TSA) is disclosed. Physical augmentation is accomplished using a TSA physical overlay (TPO) placed on top of the TSA. The TPO is constructed to transmit forces to the underlying TSA. Force transmission is accomplished by either using a flexible overlay or with a rigid mechanical overlay that transmits user forces exerted on the overlay to the underlying TSA. Incorporation of TPO identifiers (TPI) within the TPO permits identification of the TPO by a TPO detector (TPD) allowing operational characteristics of the TSA to be automatically reconfigured to conform to the currently applied TPO structure by a user computing device (UCD). The UCD may be configured to automatically load an appropriate application software driver (ASD) in response to a TPI read by the TPD from the currently applied TPO.

CROSS REFERENCE TO RELATED APPLICATIONS Utility Patent Applications

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TACTILE TOUCHSENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on May 26, 2020, withEFS ID 39536193, confirmation number 5495, Ser. No. 16/883,290.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TACTILE TOUCHSENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on Jan. 28, 2019,with EFS ID 34973120, confirmation number 6422, Ser. No. 16/259,230.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TACTILE TOUCHSENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on Jan. 19, 2018,with EFS ID 31554128, confirmation number 8726, Ser. No. 15/875,625,issued as U.S. Pat. No. 10,338,722 on Jul. 2, 2019.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TACTILE TOUCHSENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on Jun. 25, 2015,with EFS ID 2274923, confirmation number 9331, Ser. No. 14/751,076,issued as U.S. Pat. No. 10,013,092 on Jul. 3, 2018.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TOUCH SENSORDETECTOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on Jun. 25, 2014,with EFS ID 19410170, confirmation number 8306, Ser. No. 14/314,662,issued as U.S. Pat. No. 9,001,082 on Apr. 7, 2015.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for TOUCH SENSORDETECTOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg and JohnAaron Zarraga, filed electronically with the USPTO on Sep. 26, 2014,with EFS ID 20257165, confirmation number 2413, Ser. No. 14/498,478,issued as U.S. Pat. No. 9,582,098 on Feb. 28, 2017.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for RESISTIVETOUCH SENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg andJohn Aaron Zarraga, filed electronically with the USPTO on Sep. 26,2014, with EFS ID 20262520, confirmation number 8298, serial number Ser.No. 14/499,001, issued as U.S. Pat. No. 9,465,477 on Oct. 11, 2016.

This application claims benefit under 35 U.S.C. § 120 and incorporatesby reference United States Utility Patent Application for CAPACITIVETOUCH SENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg andJohn Aaron Zarraga, filed electronically with the USPTO on Sep. 27,2014, with EFS ID 20263634, confirmation number 8881, Ser. No.14/499,090, issued as U.S. Pat. No. 9,459,746 on Oct. 4, 2016.

Provisional Patent Applications

This application claims benefit under 35 U.S.C. § 119 and incorporatesby reference United States Provisional Patent Application for TACTILETOUCH SENSOR SYSTEM AND METHOD by inventors Ilya Daniel Rosenberg andJohn Aaron Zarraga, filed electronically with the USPTO on Jul. 17,2014, with EFS ID 19606351, confirmation number 5185, Ser. No.62/025,589.

This application claims benefit under 35 U.S.C. § 119 and incorporatesby reference United States Provisional Patent Application forINTERPOLATING FORCE SENSING ARRAY by inventor Ilya Daniel Rosenberg,filed electronically with the USPTO on Sep. 27, 2013, with Ser. No.61/883,597.

This application claims benefit under 35 U.S.C. § 119 and incorporatesby reference United States Provisional Patent Application forINTERPOLATING FORCE SENSING ARRAY by inventor Ilya Daniel Rosenberg,filed electronically with the USPTO on Jan. 16, 2014, with Ser. No.61/928,269.

PARTIAL WAIVER OF COPYRIGHT

All of the material in this patent application is subject to copyrightprotection under the copyright laws of the United States and of othercountries. As of the first effective filing date of the presentapplication, this material is protected as unpublished material.

However, permission to copy this material is hereby granted to theextent that the copyright owner has no objection to the facsimilereproduction by anyone of the patent documentation or patent disclosure,as it appears in the United States Patent and Trademark Office patentfile or records, but otherwise reserves all copyright rights whatsoever.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

Not Applicable

REFERENCE TO A MICROFICHE APPENDIX

Not Applicable

FIELD OF THE INVENTION

The present invention generally relates to systems and methods in thefield of touch sensor devices and has specific application to tactileoverlays for multi-touch and/or pressure-sensitive touch sensors.Specific invention embodiments may have particular applicability totouch-based force-sensing devices and methods for determining thelocation and amount of force exerted on a pressure-sensitive surface.

PRIOR ART AND BACKGROUND OF THE INVENTION

Touch sensors are input devices and are therefore typically paired witha complementary output device to provide a user with some form offeedback. In modern electronic devices this feedback is typically visual(i.e., a display). In smartphones, for instance, touch sensors areplaced directly on top of displays to allow the direct manipulation ofon-screen user interfaces. The display provides visual feedback andguides the user through the interaction.

When using a force-sensing touch solution, visual feedback can beimplemented by actually printing visual indicators on top of the touchsurface itself. For example, treadmills often have force-sensitivebuttons behind a flexible membrane. This membrane is printed with apattern that indicates button location and functionality. Some of thesemembranes also have raised edges to indicate boundaries between buttons.This adds tactile feedback for the user, and increases the interface'susability. Since the membrane is flexible, the user can transmit forcesthrough the membrane and activate the force-sensitive buttons lyingunderneath. The membrane provides the user with adequate visual/tactilefeedback, rendering a display unnecessary.

With this background as an application context, the present inventiondisclosure describes how physical augmentation of high-resolutionforce-sensitive touch sensors allows for the development ofnext-generation user interfaces. By replacing the set of discreteforce-sensitive buttons with a high-resolution two-dimensional array offorce sensors, the use of physical augmentation via overlays provides amuch more powerful implementation and user experience. Instead of havinga fixed set of buttons with a fixed membrane, it is possible to have onetouch sensor that is compatible with an infinite number of membranes,each augmenting the sensor to add a different user experience. Touchesmay still be tracked across the entire sensor so much more data isavailable to application software directing the overall user experience.

BRIEF SUMMARY OF THE INVENTION Overview

A tactile touch sensor system and method providing for physicalaugmentation of a high-resolution force-sensitive touch sensor (FSTS) isdisclosed. This physical augmentation is enabled through the use ofphysical overlays that are placed on top of the FSTS. These overlays maybe constructed to transmit forces to the underlying FSTS. This forcetransmission is accomplished by either using a flexible overlay or byfashioning a rigid mechanical overlay such that forces exerted on theoverlay by a user are transmitted to the FSTS underneath. Identificationof individual overlays by the FSTS permits operational characteristicsof the FSTS to be automatically reconfigured to conform to the currentlyapplied overlay format. Various methods teach the construction of thesephysical overlays and describe how this type of physical augmentationmay be used to increase the functionality and modularity of a FSTSmodule and FSTS systems. These systems may in some embodiments beaugmented with additional resistive and/or capacitive sensors toautomatically identify or interact with the physical overlay applied tothe FSTS.

The present invention involves coupling a physical overlay with ahigh-resolution, multi-touch, force-sensitive touch sensor. The physicaloverlay is designed to provide a user with visual/tactile feedback, andmay be coupled with matching software to create a functional userinterface. Since the physical overlay is placed between a user and thetouch sensor, the overlay must be designed so that it transmits forcescoming from the user to the sensor. These overlays can be flat orthree-dimensional membranes, molded out of a flexible and/or compliantmaterial. If an overlay is flexible, the overlay will naturally transmitforces from the user to the touch sensor. Alternatively, it is possibleto construct rigid, mechanical widgets (buttons, sliders, knobs, etc.)which are designed to transmit user-supplied force to the underlyingtouch sensor. Finally, a programmable, deformable physical interface canbe used to support a wide range of application-specific user interfaces.

Characteristics and Advantages of the Invention

Today, touch interfaces are primarily found on smartphones and tablets.One of the issues with these interfaces is that they have no tactilefeedback. There have been industry efforts to “add back” the tactilefeedback in these interfaces through the use of haptics. This has a wideset of challenges, and many efforts fail to effectively offer adequatetactile feedback. By physically augmenting force-sensitive touchsensors, it is possible to create physical and intuitive interfaces thatoffer both tactile and visual feedback, which increases the usability ofthe touch sensor. Instead of trying to “add back” the sensation of abutton, you can design an overlay for a force-sensitive touch sensorthat actually has a button. One can create overlays out of differentmaterials, with different elasticity/compliance. With a “squishy”material, the user can better determine the level of force he/she isexerting on the sensor.

A major advantage of the disclosed invention is that it allowsconstruction using a modular approach, so that one touch sensor iscompatible with a wide array of physically flexible overlays. Thisbecomes much more cost-effective for the end-user, and eliminates theend-user purchase requirement of sensor interfaces that are designed fora single application. For instance, a musician can have aforce-sensitive touch sensor and also have two overlays: a pianokeyboard overlay and a drum pad overlay. This modular approach allowsthe musician to purchase more overlays (which are relativelyinexpensive) and use them on his one touch sensor. Alternatively, theend-user could have multiple touch sensors and mix and match whichoverlays he is using at any given time.

Exemplary Invention Application Contexts

One of the most obvious use-cases for the present invention is theimplementation of a standard QWERTY keyboard functionality. Typing on aflat touch sensor is very unpleasant, and most people need tactilefeedback to type accurately and efficiently. Creating a physical QWERTYkeyboard overlay would solve some of these issues and make typing on atouch sensor much more enjoyable. In addition to a standard QWERTYkeyboard, simply by changing the overlay, keyboards for differentlanguages (such as French) and different key arrangements (such asDVORAK) can be made. Even unusual keyboards, such as court-stenographerkeyboards, and keyboards that use highly unconventional layouts andinterface schemes can be created simply by changing the overlay.

An infinite number of musical instruments could be fashioned using thepresent invention. For example, it is possible to make a drum pad oreven a piano keyboard using the present invention teachings. For a drumpad, it is possible to 3D-print with a flexible material, and create anytype of drum kit or layout. For a piano, it is possible to build anoverlay that indicates piano key location. Since touches are trackedacross the entire sensor, the sensor knows where the user is touchingwithin a given key. This data can be used to expand the functionality ofthe piano. For example, software can use the fingers position within agiven key to pitch-bend the current note a user is playing. Taking thisidea further, novel forms of instruments having different buttonlayouts, sizes, and shapes can be created just by creating customoverlays.

Instead of having a monolithic overlay that covers the entire sensor, itis possible to augment the touch interface with multiple smalleroverlays. In order to secure the overlays to the touch sensor, it ispossible to employ the use of magnets to hold each overlay against thesurface of the sensor. This allows a user to create user interfacebuilding blocks and allow a user to develop new interfaces on the fly.These magnetic building blocks could be as simple as a rectangle whichmarks a special area of the sensor. This might include a drawingsoftware application with a rectangle indicating where the user can drawon the sensor. Other building blocks could be more complicated, such asa physical slider bar. This slider may be built so that it transmitsforces through to the touch sensor. This permits adding the slider nextto the drawing rectangle and using it to control the drawing line widthor other sketching parameters. Besides a slider and a drawing area, manyother mechanical building blocks may be created to emulate physicalinterfaces, such as knobs, physical buttons, toggle switches, andjoysticks. With this modular approach, it is possible to develop bothsimple and highly complex physical interfaces. This modular approach tobuilding physical interfaces could have huge implications in medical andindustrial fields, where custom controls for specialized equipment canbe very expensive.

BRIEF DESCRIPTION OF THE DRAWINGS

For a fuller understanding of the advantages provided by the invention,reference should be made to the following detailed description togetherwith the accompanying drawings wherein:

FIG. 1 illustrates an overview block diagram of a preferred exemplaryinvention system embodiment;

FIG. 2 illustrates an overview flowchart of a preferred exemplaryinvention method embodiment;

FIG. 3 illustrates a block diagram of a preferred exemplary inventionsystem embodiment;

FIG. 4 illustrates a flowchart of a preferred exemplary invention methodembodiment;

FIG. 5 illustrates a flowchart of a preferred exemplary contact/eventmapping method embodiment;

FIG. 6 illustrates a flowchart of a preferred exemplary event generationmethod embodiment depicting how the system software reads touch data andeventually determines if a particular touch has activated a region ofinterest on an overlay;

FIG. 7 illustrates how the system software reads touch data andeventually determines if a particular touch has activated a region ofinterest on a TPO overlay;

FIG. 8 illustrates various methods by which magnets may be incorporatedinto TSA/TPO structures;

FIG. 9 illustrates a schematic depicting detection of TPO identificationusing magnetometers;

FIG. 10 illustrates a diagram depicting detection of TPO identificationusing a magnet-encoded overlay;

FIG. 11 illustrates a diagram depicting the use of magnets/magnetometersto detect the presence of a TPO overlay;

FIG. 12 illustrates a flowchart depicting a method for automaticdetection of a TPO overlay using magnetometers;

FIG. 13 illustrates a flowchart depicting a method for automaticdetection of a TPO overlay using an embedded RFID device within the TPOoverlay and a RFID antenna in the TSA;

FIG. 14 illustrates a flowchart depicting a method for automaticdetection of an arbitrarily placed TPO overlay using an embedded RFIDdevice within the TPO overlay and RFID antennas in the TSA;

FIG. 15 illustrates a flowchart depicting vertical and horizontalantennas placed within the TSA for the purposes of automaticidentification of a TPO overlay using an embedded RFID device within theTPO overlay;

FIG. 16 illustrates a flowchart depicting a method for automaticdetection of a TPO overlay using RFID communications;

FIG. 17 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) useful inimplementing some embodiments of the present invention;

FIG. 18 illustrates a top right rear perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) useful inimplementing some embodiments of the present invention;

FIG. 19 illustrates a bottom right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) useful inimplementing some embodiments of the present invention;

FIG. 20 illustrates a bottom right rear perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) useful inimplementing some embodiments of the present invention;

FIG. 21 illustrates a top view of a preferred exemplary touch sensitivearray (TSA) tablet interface (TTI) useful in implementing someembodiments of the present invention;

FIG. 22 illustrates a bottom view of a preferred exemplary touchsensitive array (TSA) tablet interface (TTI) useful in implementing someembodiments of the present invention;

FIG. 23 illustrates a right side view of a preferred exemplary touchsensitive array (TSA) tablet interface (TTI) useful in implementing someembodiments of the present invention;

FIG. 24 illustrates a rear side view of a preferred exemplary touchsensitive array (TSA) tablet interface (TTI) useful in implementing someembodiments of the present invention;

FIG. 25 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with afirst exemplary custom TTA pressure overlay (TPO);

FIG. 26 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a first exemplary custom TTA pressure overlay(TPO);

FIG. 27 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with asecond exemplary custom TTA pressure overlay (TPO);

FIG. 28 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a second exemplary custom TTA pressure overlay(TPO);

FIG. 29 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with athird exemplary custom TTA pressure overlay (TPO);

FIG. 30 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a third exemplary custom TTA pressure overlay(TPO);

FIG. 31 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with afirst exemplary typewriter keyboard TTA pressure overlay (TPO);

FIG. 32 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a first exemplary typewriter keyboard TTA pressureoverlay (TPO);

FIG. 33 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with asecond exemplary typewriter keyboard TTA pressure overlay (TPO);

FIG. 34 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a second exemplary typewriter keyboard TTA pressureoverlay (TPO);

FIG. 35 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with athird exemplary typewriter keyboard TTA pressure overlay (TPO);

FIG. 36 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a third exemplary typewriter keyboard TTA pressureoverlay (TPO);

FIG. 37 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with afirst exemplary piano keyboard TTA pressure overlay (TPO);

FIG. 38 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a first exemplary piano keyboard TTA pressureoverlay (TPO);

FIG. 39 illustrates a top right front perspective view of a preferredexemplary touch sensitive array (TSA) tablet interface (TTI) with asecond exemplary piano keyboard TTA pressure overlay (TPO);

FIG. 40 illustrates a top view and right/front sectional perspectiveviews of a preferred exemplary touch sensitive array (TSA) tabletinterface (TTI) with a second exemplary piano keyboard TTA pressureoverlay (TPO);

FIG. 41 illustrates perspective and sectional views of an exemplarydeformable membrane activated by piezo-electric elements;

FIG. 42 illustrates perspective and sectional views of an exemplarydeformable membrane activated by pumped air/fluid elements;

FIG. 43 illustrates perspective and sectional views of an exemplarydeformable membrane activated by heat expanding elements;

FIG. 44 illustrates an exemplary TSA/TPO configuration in which lightpiping is used to illuminate TPO structures;

FIG. 45 illustrates an exemplary TSA/TPO configuration in which lightpiping is used to illuminate TPO structures;

FIG. 46 illustrates an exemplary TSA/TPO configuration that implementsenergy harvesting for use by the TPO structure;

FIG. 47 illustrates an exemplary TSA/TPO configuration that implementsenergy harvesting for use by the TPO structure;

FIG. 48 illustrates an exemplary TSA tablet structure on which a varietyof TPO elements are attached.

FIG. 49 illustrates top perspective and top perspective sectional viewsof a TPO peripheral edge insertion attachment mechanism between the TPOand the TSA assembly;

FIG. 50 illustrates front perspective sectional views of a TPOperipheral edge insertion attachment mechanism sequence between the TPOand the TSA assembly;

FIG. 51 illustrates top perspective and top perspective sectional viewsof a TPO side edge insertion attachment mechanism between the TPO andthe TSA assembly;

FIG. 52 illustrates top and bottom perspective views of a TPO side edgeinsertion attachment mechanism between the TPO and the TSA assemblydepicting open and closed edge invention variants;

FIG. 53 illustrates a top perspective view of a TPO magnetic bezelattachment mechanism between the TPO and the TSA assembly;

FIG. 54 illustrates a bottom perspective view of a TPO magnetic bezelattachment mechanism between the TPO and the TSA assembly;

FIG. 55 illustrates a top perspective exploded view of a TPO hingedbezel attachment mechanism between the TPO and the TSA assembly;

FIG. 56 illustrates a top perspective assembled view of a TPO hingedbezel attachment mechanism between the TPO and the TSA assembly;

FIG. 57 illustrates a perspective view of an exemplary TPO and TSAassembly for use in describing TPO identification methodologies taughtby the present invention;

FIG. 58 illustrates perspective views of an exemplary TPO incorporatingmagnetic attachment means;

FIG. 59 illustrates a perspective view of an exemplary TPO incorporatingmagnetic attachment means and TPO magnetic identification means;

FIG. 60 illustrates a perspective view of an exemplary TPO incorporatingmagnetic attachment means and raised indicia identification means;

FIG. 61 illustrates a bottom view of an exemplary TPO incorporatingmagnetic attachment means with bar code identification means and QR-codeidentification means;

FIG. 62 illustrates a perspective view of an exemplary TPO incorporatingraised bar code identification means;

FIG. 63 illustrates bottom and perspective views of an exemplary TPOincorporating magnetic attachment means and RFID identification means;

FIG. 64 illustrates perspective views of an exemplary TPO incorporatingmagnetic attachment means and switched TPO identification using shortingstrips on the TPO and corresponding switch contacts on the surface ofthe TSA;

FIG. 65 illustrates top perspective and bottom perspective views of anexemplary TPO key embodiment;

FIG. 66 illustrates top front perspective and front sectional views ofan exemplary TPO key embodiment with the key in an un-depressed state;

FIG. 67 illustrates top front perspective and front sectional views ofan exemplary TPO key embodiment with the key in a depressed state;

FIG. 68 illustrates top diagonal perspective and diagonal sectionalviews of an exemplary TPO key embodiment with the key in an un-depressedstate and depicts the attachment magnet structures;

FIG. 69 illustrates top front and top rear perspective views of anexemplary TPO rocker switch embodiment;

FIG. 70 illustrates bottom front perspective and bottom front sectionalperspective views of an exemplary TPO rocker switch embodiment;

FIG. 71 illustrates side sectional perspective and side sectional viewsof an exemplary TPO rocker switch embodiment in a first switch position;

FIG. 72 illustrates side sectional perspective and side sectional viewsof an exemplary TPO rocker switch embodiment in a second switchposition;

FIG. 73 illustrates a top perspective view of an exemplary TPO sliderembodiment;

FIG. 74 illustrates a bottom perspective view of an exemplary TPO sliderembodiment;

FIG. 75 illustrates top and bottom views of an exemplary TPO sliderembodiment;

FIG. 76 illustrates front, side, and diagonal perspective sectionalviews of an exemplary TPO slider embodiment;

FIG. 77 illustrates top and bottom perspective views of an exemplary TPOdial knob embodiment;

FIG. 78 illustrates front sectional views of an exemplary TPO dial knobembodiment;

FIG. 79 illustrates side sectional views of an exemplary TPO dial knobembodiment;

FIG. 80 illustrates diagonal sectional views of an exemplary TPO dialknob embodiment;

FIG. 81 illustrates a top right front perspective view of an exemplarytwo-piece TPO mouse/puck embodiment;

FIG. 82 illustrates a bottom right front perspective view of anexemplary two-piece TPO mouse/puck embodiment;

FIG. 83 illustrates front, rear, and side views of an exemplarytwo-piece TPO mouse/puck embodiment;

FIG. 84 illustrates top and bottom views of an exemplary two-piece TPOmouse/puck embodiment;

FIG. 85 illustrates an assembly view of an exemplary two-piece TPOmouse/puck embodiment;

FIG. 86 illustrates perspective isolation views of the mouse/puck shellin an exemplary two-piece TPO mouse/puck embodiment;

FIG. 87 illustrates perspective isolation views of the mouse/puckcontact surface in an exemplary two-piece TPO mouse/puck embodiment;

FIG. 88 illustrates a perspective isolation view of a mouse/puck contactsurface variant in an exemplary two-piece TPO mouse/puck embodiment;

FIG. 89 illustrates top and bottom perspective views of an exemplary TPOjoystick embodiment;

FIG. 90 illustrates front, top, and bottom views of an exemplary TPOjoystick embodiment;

FIG. 91 illustrates front perspective sectional and front sectionalviews of an exemplary TPO joystick embodiment;

FIG. 92 illustrates side perspective sectional and side sectional viewsof an exemplary TPO joystick embodiment;

FIG. 93 illustrates diagonal perspective sectional views of an exemplaryTPO joystick embodiment;

FIG. 94 illustrates side sectional views of an exemplary TPO joystickembodiment illustrating various joystick positions and springconditions;

FIG. 95 illustrates top and bottom perspective views of an exemplary TPOjoystick embodiment incorporating a pushbutton selector;

FIG. 96 illustrates front perspective sectional and front sectionalviews of an exemplary TPO joystick embodiment incorporating a pushbuttonselector;

FIG. 97 illustrates a top perspective view of an exemplary TPO trackpadembodiment;

FIG. 98 illustrates a bottom perspective view of an exemplary TPOtrackpad embodiment;

FIG. 99 illustrates a top perspective front section view of an exemplaryTPO trackpad embodiment;

FIG. 100 illustrates a top perspective diagonal section view of anexemplary TPO trackpad embodiment;

FIG. 101 illustrates a top perspective view of an exemplary TPO keypadembodiment;

FIG. 102 illustrates a bottom perspective view of an exemplary TPOkeypad embodiment;

FIG. 103 illustrates a top perspective front section view of anexemplary TPO keypad embodiment;

FIG. 104 illustrates a top perspective diagonal section view of anexemplary TPO keypad embodiment;

FIG. 105 illustrates a top perspective view and top perspectivefront/side sectional views of a basic flat trackpad/keypad overlay thatmay or may not have printed text or surface key texturing associatedwith its construction;

FIG. 106 illustrates a top perspective view and top perspectivefront/side sectional views of a trackpad/keypad overlay thatincorporates edge indentations around buttons/keys;

FIG. 107 illustrates a top perspective view and top perspectivefront/side sectional views of a trackpad/keypad overlay thatincorporates edge ridges around buttons/keys;

FIG. 108 illustrates a top perspective view and top perspectivefront/side sectional views of a raised key/button trackpad/keypadoverlay;

FIG. 109 illustrates a top perspective view and top perspectivefront/side sectional views of a depressed/lowered key/buttontrackpad/keypad overlay;

FIG. 110 illustrates a top perspective view and top perspectivefront/side sectional views of a depressed/lowered key/buttontrackpad/keypad overlay with raised bump indicia;

FIG. 111 illustrates a top perspective view and top perspectivefront/side sectional views of a domed key/button trackpad/keypadoverlay;

FIG. 112 illustrates a top perspective view and top perspectivefront/side sectional views of a domed key/button trackpad/keypad overlaywith key caps;

FIG. 113 illustrates top front right and top rear left perspective viewsof an exemplary TPO key structure incorporating modular constructionfeatures;

FIG. 114 illustrates bottom front right and bottom rear left perspectiveviews of an exemplary TPO key structure incorporating modularconstruction features;

FIG. 115 illustrates top and bottom views of an exemplary TPO keystructure incorporating modular construction features;

FIG. 116 illustrates front and side views of an exemplary TPO keystructure incorporating modular construction features;

FIG. 117 illustrates top front right and top rear left perspective viewsof an exemplary assembled TPO keyboard structure incorporating modularconstruction features;

FIG. 118 illustrates a top front side sectional perspective view of anexemplary assembled TPO keyboard structure incorporating modularconstruction features;

FIG. 119 illustrates a top right side sectional perspective view of anexemplary assembled TPO keyboard structure incorporating modularconstruction features;

FIG. 120 illustrates a top front side sectional perspective detail viewof an exemplary assembled TPO keyboard structure incorporating modularconstruction features;

FIG. 121 illustrates top and bottom views of an exemplary TPO keystructure incorporating modular construction features with integratedautomatic identification mechanisms;

FIG. 122 illustrates bottom right front and bottom left rear perspectiveviews of an exemplary TPO key structure incorporating modularconstruction features with integrated automatic identificationmechanisms;

FIG. 123 illustrates a front view of an exemplary TPO key structureincorporating modular construction features with integrated automaticidentification mechanisms;

FIG. 124 illustrates a side view of an exemplary TPO key structureincorporating modular construction features with integrated automaticidentification mechanisms;

FIG. 125 illustrates a bottom view, top right front perspective view,and bottom right front perspective view an exemplary assembled TPOkeyboard structure incorporating modular construction features withintegrated automatic identification mechanisms;

FIG. 126 illustrates a top right front perspective view an exemplary TSAtablet combined with a number of TPO keyboard structures;

FIG. 127 illustrates a top view an exemplary TSA tablet combined with anumber of TPO keyboard structures; and

FIG. 128 illustrates a flowchart depicting automatic loading ofapplication software and device drivers associated with placement ofautomatically identified TPO keyboard structures on a TSA.

DESCRIPTION OF THE PRESENTLY PREFERRED EXEMPLARY EMBODIMENTS

While the present invention is susceptible of embodiment in manydifferent forms, there is shown in the drawings and will herein bedescribed in detailed preferred embodiments of the invention with theunderstanding that the present disclosure is to be considered as anexemplification of the principles of the invention and is not intendedto limit the broad aspect of the invention to the embodimentillustrated.

The numerous innovative teachings of the present application will bedescribed with particular reference to the presently preferredembodiment, wherein these innovative teachings are advantageouslyapplied to the particular problems of a TACTILE TOUCH SENSOR SYSTEM ANDMETHOD. However, it should be understood that this embodiment is onlyone example of the many advantageous uses of the innovative teachingsherein. In general, statements made in the specification of the presentapplication do not necessarily limit any of the various claimedinventions. Moreover, some statements may apply to some inventivefeatures but not to others.

Touch Sensor Array (TSA) Definition

Within the context of the present invention, the term “Touch SensorArray (TSA)” is defined as the interpolating high-resolutionforce-sensitive touch sensor (FSTS) systems as described in theabove-referenced patents and patent applications incorporated byreference in this application.

TPO Manufacturing Not Limitive

The present invention anticipates a means of producing TPO overlays inmany preferred embodiments by injection molding and/or 3D printing.However, the present invention also anticipates that TPO overlays may belaser-cut from blank overlays or stock overlay materials.

TPO Overlay Transparency Not Limitive

An additional type of overlay anticipated by the present invention is atransparent overlay that retains a printed sheet of paper. This TPOoverlay enables end-users that do not have access to a 3D printer orlaser cutter to quickly prototype new overlay designs and apply them tothe transparent overlay front or back surface.

TPO Overlay Material Not Limitive

With respect to the manufacture of TPO overlays, it should be noted thatTPO overlays may be made of a squishy material such as a urethane foam(Rogers Corporation PORON® brand microcellular urethanes are provided asan example), silicone foam, neoprene foam, and any regular (non-foamed)silicone or rubber (including thermoplastic polyurethane (TPU)).

Mouse Not Limitive

The term “mouse” when used in the context of a moveable or non-movableTPO overlay should be given a broad interpretation to cover any kind of“puck” which might not even have buttons or a scroll wheel on it. Thus,the term “mouse” when used herein may literally be an object that theuser moves and which the TSA sensor tracks. Within this context it isalso possible with the present invention for the TSA to track therotational orientation of the mouse/puck as well as the forcedistribution (so as to be able to detect tilting pressure applied to themouse/puck).

TPO Automatic Identification Not Limitive

While the discussion herein regarding identification of TPO overlaysconcentrates on automatic identification of these structures, thepresent invention also anticipates scenarios in which some types of TPOoverlays (such as home-made 3D printed overlays), allow the user tospecify the overlay ID and/or location on the TSA surface manually.

TSA/TPO Magnetic Coupling Not Limitive

Many embodiments illustrated herein make use of paired magnets in theTSA and TPO structures to provide a mechanical coupling mechanismbetween the TSA and TPO. In some embodiments one of these magnets may bereplaced by a ferromagnetic material (iron, steel, etc.) that ismagnetically coupled to the remaining magnet in the coupled pair. Thiswould provide, for example, the use of a ferromagnetic TPO or TPO bezelto be mated to magnets within the TSA or alternatively magnets withinthe TPO or TPO bezel to be mated to ferromagnetic material embeddedwithin the TSA or the periphery of a bezel retaining the TSA. Thus, theterm “magnet” and similar terms when used herein covers a wide varietyof magnetically coupled mating methodologies.

TSA Construction

The TSA as described herein may comprise a pressure-sensitive surface(PSS) incorporating row-column force detection and/or row-column forceinterpolation detection.

Sensor Technologies Application Context

One of the main components of the present invention is ahigh-resolution, multi-touch, force-sensitive touch sensor. Thistechnology is perfectly suited for physical augmentation, because unlikeother touch technologies, the touch sensor can be activated with anyobject that exerts a force. With a capacitive touch technology, youwould only be able to activate the sensor with conductive objects. Thiswould make construction of overlays more difficult and would requirespecial materials for fabrication. Many optical solutions will also notwork, because most solutions transmit/receive light signals from theside of the sensor. If you placed an overlay on the sensor, it wouldpotentially block paths for this light to travel, and you wouldn't beable to sense interaction on the overlay itself. A multi-touch,force-sensitive touch sensor is used in the preferred embodiment of thepresent invention. In the rest of the disclosure, “touch sensor” shouldbe understood to be a multi-touch, force-sensitive touch sensor.

System Overview (0100)

A general overview of the present invention system is depicted in theblock diagram of FIG. 1 (0100). Here the tactile touch sensor system(TTS) (0110) comprises a touch sensor array (TSA) (0111) as generallydescribed in the patents and patent applications identified above andincorporated herein by reference. To this TSA (0111) a TSA physicaloverlay (TPO) (0112) is applied. This TPO (0112) may incorporate a widevariety of physical forms, many of which are provided by example in thepresent application and described further in detail below. The TPO(0112) may be of a fixed integrated form but also may be of disparateforms that are mated together to form a customized physical form.

Each of the TPO (0112) (whether integrated form or disparate form) mayincorporate a TPO identifier (TPI) (0113) that uniquely identifies thetype of TPO (0112) that constitutes the overlay structure. This TPI(0113) is then read by a TPO detector (TPD) (0114) that translates thisinformation into a binary identification format (BIF). This BIF issuitable for interpretation by a TTS hardware computer interface (HCI)(0115) and is subsequently transmitted to a user computing device (UCD)(0101).

The UCD (0101) loads appropriate software and/or device drivers from anapplication software driver (ASD) (0102) database that are then used tointerpret contact/pressure information retrieved from the TSA (0111) asthe user (0103) interacts with the TPO (0112). Depending on the TPI(0113) detected by the TPD (0114) and the subsequent software driverloaded by the UCD (0101) from the ASD (0102), a variety of graphicaluser interfaces (GUI) (0104) may be presented to the user (0101).

Method Overview (0200)

A general overview of the present invention method is depicted in theflowchart of FIG. 2 (0200). This tactile touch sensor (TTS) methodcomprises the following steps:

-   -   (1) Encoding a TPI overlay identification within a touch sensor        physical overlay (TPO) to uniquely identify the function of the        TPO (0201);    -   (2) Applying the TPO to the surface of a touch sensor array        (TSA) (0202);    -   (3) Reading the TPI with a TPO detector (0203);    -   (4) Interrogating the TPI using TTS hardware computer interface        (HCS) using a user computing device (UCD) (0204);    -   (5) Loading an application software driver (ASD) on said UCD        based on the TPI read by said TPD (0205);    -   (6) Presenting a software application/interface to a user based        on the TPI read by the TPD (0206);    -   (7) Interpreting inputs from the TSA inputs through the HCI        based on the TPI read by the TPD (0207); and    -   (8) Proceeding to step (6) if the ISO has not been modified or        replaced and proceeding to step (2) if the TPD has detected a        change in the TPO applied to the TSA.

This general method may be modified heavily depending on a number offactors, with rearrangement and/or addition/deletion of stepsanticipated by the scope of the present invention. Integration of thisand other preferred exemplary embodiment methods in conjunction with avariety of preferred exemplary embodiment systems described herein isanticipated by the overall scope of the present invention.

System Detail (0300)

A detail overview of the present invention system is depicted in theflowchart of FIG. 3 (0300). The touch sensor array detector (TSA) (0301)forms the basis for collection of pressure sensor information from apressure sensitive surface and is described in the referenced patentdocuments included by reference. The user (0302) interacts with agraphical user interface (0303) which is associated with a physical TSApressure overlay (TPO) (0304) that is detected and identified with a TPOdetector (TPD) (0305). A database of contact/event mappings (0306) isthen used to associated software functions with the raw touch sensordata (0307) received from the TSA (0301). The raw touch sensor data(0307) is then interpreted by a contact location extraction process(0308) as configured by a contact/event mapping and event generator(0309) that has been configured by the automatic TPD detection (0305) ofthe TPO (0304). Events generated by the event generator (0309) are thentransformed by a USB/BLUETOOTH® composite software interface (0310) intoappropriate protocols (MIDI protocol (0311), serial protocol (0312), HIDmouse protocol (0313), HID keyboard protocol (0314), HID digitizerprotocol (0315), HID joystick protocol (0316), etc.) and delivered to aUSB/BLUETOOTH® host (0320) for interpretation by the appropriatesoftware driver ((0321), (0323) (0325)) and associated softwareapplication ((0322), (0324), (0326)).

One advantage of this system is the ability to automatically identify(0305) a particular TPO overlay (0304) and load appropriate softwaredrivers/applications (0309) based on this identification process.

Software Interface

It is important to note that physical touch sensor augmentation requiresa software component to enable an effective user interface. There mustbe software that is aware of what TPO overlay is on top of the TSA touchsensor, so that touch data can be translated into functionality asindicated by the overlay. For instance, if a piano keyboard overlay isplaced on a sensor, the user must also have software enabled that istranslating touches into piano key presses. The application software cangenerate audio directly or can send key press events to other softwareusing a standard format such as MIDI.

It is also important to keep the overlay “in sync” with the software. Ifyou replace the previously mentioned piano keyboard overlay with a drumpad and the piano software is still running, the drum pad will have veryunexpected results (playing the drum pads would activate keys in thepiano software). This invention disclosure teaches several methods forkeeping the software “in sync” with the overlay. These methods will bedescribed in a later section.

Method Detail (0400)

A detail overview of the present invention method is depicted in theflowchart of FIG. 4 (0400). This tactile touch sensor (TTS) methodcomprises the following steps:

-   -   (1) Reading touch sensor data from a TSA touch sensor (0401);    -   (2) Extracting contact locations from the touch sensor data        (0402);    -   (3) Configuring contact/event mapping based on the detected        contact locations (0403);    -   (4) Generating events based on the detected contact locations        (0404);    -   (5) Sending event data through a specified API interface to an        associated software application (0405); and    -   (6) Looping to step (1) to read additions touch sensor data        (0406).

FIG. 4 (0400)-FIG. 7 (0700) depict how the system software reads touchdata and eventually determines if a particular touch has activated aregion of interest on an overlay. FIG. 4 (0400) provides an overview ofsystem operation. FIG. 5 (0500) details the configuration ofcontact/event mapping. FIG. 6 (0600) details the generation of eventsbased on contact locations.

The overlay in this example is provided in FIG. 7 (0700) and has tworegions of interests, or two “features”. The underlying software is madeto run with this particular overlay, so it also knows where these twofeatures are on the touch sensor. When a finger touches the TPO overlay,force is transmitted through the flexible overlay to the underlyingforce-sensitive touch sensor. This generates a force response the sensorsees for this particular touch. The sensor can use this response tocalculate a contact position. The software uses its knowledge of the twofeatures to determine if this touch lies within one of these regions. Inthis case, the software detects that the features on the left has beenactivated. The software can then trigger an event associated with theactivation of the left feature.

Configure Contact/Event Mapping Method Detail (0500)

A detail overview of the present invention contact/event configurationmapping method is depicted in the flowchart of FIG. 5 (0500). Thistactile touch sensor (TTS) method comprises the following steps:

-   -   (1) Determining if a TPO overlay is detected and if so,        proceeding to step (3) (0501);    -   (2) Loading a default contact/event map and proceeding to        step (4) (0502);    -   (3) Loading a contact/event map associated with the TPO overlay        (0503);    -   (4) Determining if the user is manually defining a contact/event        map via the GUI and if not, proceeding to step (6) (0504);    -   (5) Adjusting the loaded contact/event map per user        specification from the GUI (0505);    -   (6) Saving the contact/event map (0506); and    -   (7) Returning to the calling procedure (0507).        This general method may be modified heavily depending on a        number of factors, with rearrangement and/or addition/deletion        of steps anticipated by the scope of the present invention.

Generate Events on Contact Locations Method (0600)

A detail overview of the present invention contact locations eventgeneration method is depicted in the flowchart of FIG. 6 (0600). Thistactile touch sensor (TTS) method comprises the following steps:

-   -   (1) Examining a contact location (0601);    -   (2) Examining an “active region” in the contact/event map        (0602);    -   (3) Determining if the contact locations reside within the        “active region” in the contact event/map, and if so, proceeding        to step (6) (0603);    -   (4) Determining if there are additional “active regions” in the        contact event map to be inspected, and if not, proceeding to        step (7) (0604);    -   (5) Repeating steps (2)-(4) for all “active regions” in the        contact event/map (proceed to step (2)) (0605);    -   (6) Generating an event that is specified by the currently        active region per the contact/event mapping (0606);    -   (7) Determining if there are any more contacts to examine, and        if not, proceeding to step (9) (0607);    -   (8) Repeating steps (1)-(8) for all contacts detected (proceed        to step (1)) (0608); and    -   (9) Returning to the calling procedure (0609).        This general method may be modified heavily depending on a        number of factors, with rearrangement and/or addition/deletion        of steps anticipated by the scope of the present invention.

Generating Events on Contact Locations (0700)

An example of how events are generated based on contact locations isdepicted in the diagram of FIG. 7 (0700). Here two active areas (1 and2) are depicted and corresponding active area contact/event mapping isdetailed. This diagram provides an example framework by which theprocedures in FIG. 4 (0400)-FIG. 6 (0600) may operate.

TSA/TPO Magnet Placement Techniques (0800)

Various methods by which magnets may be incorporated in TSA/TPOstructures are generally depicted in the diagram of FIG. 8 (0800). Herea generic TSA/TPO structure (0810) is presented for illustrativepurposes that combines a number of anticipated magnet placementtechniques. Within this generic sampling context, the magnets may beplaced/embedded internally (0811) within the TSA/TPO structure (0810),positioned through the entire structure (0812), placed flush to asurface of the structure (0813), or protruding from the surface of thestructure (0814). In any of these situations the magnets may be placedinside the overlay during an injection molding process or gluedin/inserted after the injection molding process is complete. In any ofthese situations the magnet may be configured in any physical form andplaced when the TSA/TPO membrane (0810) is injected molded or in somecircumstances inserted after the injection molding process is completed.For those situations in which the magnets are inserted after injectionmolding, it may be possible to fabricate the TSA/TPO with a magnetcavity having an external surface peripheral edge diameter slightlysmaller than the magnet so as to capture the magnet when inserted intothe magnet cavity.

Additionally, the use of flexible magnetic strips that are flush (0815)to the surface of the TSA/TPO (0810) and/or protruding (0816) from thesurface of the TSA/TPO (0810) are also anticipated in these scenarios.As generally depicted, any of the magnetic structures depicted may bepositioned as protruding (0817) or flush (0818, 0819) with the TSA/TPO(0810) surface.

Magnetometer TPO Identification (0900)-(1200)

The present invention may implement identification of the TPO bymagnetometer sensors as generally depicted in FIG. 9 (0900)-FIG. 12(1200). FIG. 9 (0900) depicts a typical hardware interface used withinthe TSA structure to individually detect magnets that are placed withinthe TPO for identification purposes. FIG. 10 (1000) illustrates atypical TSA/TPO pair in which magnetometers in the TSA are matched withcorresponding embedded magnet positions in the TPO to provide a decodedTPO overlay identification. The magnetometers may also be used to detectthe presence of the TPO overlay as generally depicted in FIG. 11 (1100)where magnetometers in the TSA are activated on the presence of detectedmagnets in the corresponding TPO locations.

A general method for the automatic magnetic detection of TPO overlays isgenerally depicted in FIG. 12 (1200) and involves the following steps:

-   -   (1) Scanning magnetometers in the TSA (1201);    -   (2) Determining if any magnets were detected, and if not,        proceeding to step (7) (1202);    -   (3) Waiting a predetermined amount of time to allow settling of        the TPO overlay (1203);    -   (4) Scanning the magnetometers in the TSA (1204);    -   (5) Determining if the number of detected magnets in the TPO has        changed, and if so, proceeding to step (3) (1205);    -   (6) Reporting a TPO overlay ID as decoded by the magnetometers        in the TSA and proceeding to step    -   (8) (1206);    -   (7) Reporting no TPO overlays detected (1207); and    -   (8) Returning to the calling procedure (1208).        This general method may be modified heavily depending on a        number of factors, with rearrangement and/or addition/deletion        of steps anticipated by the scope of the present invention.

RFID TPO Identification (1300)-(1600)

The present invention may implement identification of the TPO by radiofrequency identification (RFID) tag/sensors as generally depicted inFIG. 13 (1300)-FIG. 15 (1600). FIG. 13 (1300) how a RFID antenna in theTSA may be mated with a corresponding RFID tag in the TPO to allowidentification and presence detection of the TPO by the TSA. FIG. 14(1400) depicts how an array of RFID antennas within the TSA may be usedto locate the position of a number of TPO structures on the TSA surfacevia the use of RFID tags within the various TPO structures. FIG. 15(1500) depicts how horizontal/vertical antennas may be placed within theTSA and TPO to provide for TPO detection and communication between thesetwo structures.

A general method for the automatic RFID detection of TPO overlays isgenerally depicted in FIG. 16 (1600) and involves the following steps:

-   -   (1) Scanning a single RFID coil in the TSA (1601);    -   (2) Determining if any RFIDs were detected, and if not,        proceeding to step (4) (1602);    -   (3) Reporting a TPO overlay ID as read from the RFID (1603);    -   (4) Repeating steps (1)-(3) for all remaining RFID coils in the        TSA (proceed to step (1) (1604); and    -   (5) Returning to the calling procedure (1605).        This general method may be modified heavily depending on a        number of factors, with rearrangement and/or addition/deletion        of steps anticipated by the scope of the present invention.

TSA Tablet Interface (TTI) (1700)-(2400)

The present invention may implement the described tactile touch sensorsystem/method using a touch sensitive array (TSA) tablet interface (TTI)as generally depicted in FIG. 17 (1700)-FIG. 24 (2400). This TTIprovides the foundation on which many preferred invention embodimentsmay be constructed. A wide variety of TPO overlays as described belowmay be attached to the TTI active TSA pressure sensitive surface andcommunicate with the TSA electronics and remote host computers using avariety of wired and wireless communication protocols.

The tabled illustrated in these figures can be constructed with any typeof perimeter form. Additionally while a set number of keys are depictedin the diagrams that follow, the present invention may incorporate anynumber of keys in based on application context. Keys represented in thefigures may incorporate embossed indicia (via an embossing manufacturingprocess), but this is not a limitation of the present invention.

Exemplary 3D Overlays (2500)-(4000)

TPO overlays may be constructed so they are three-dimensional. This canbe achieved by molding or 3D-printing a flexible material into athree-dimensional overlay. For a piano, an overlay could be created suchthat the black keys are taller than the white keys. The overlay couldalso have gaps in between the keys, so that a user can feel where pianokeys start/end. This type of overlay provides both visual and tactilefeedback to the user. FIG. 25 (2500)-FIG. 40 (4000) shows cross-sectionsof various features that can be added to an overlay when using athree-dimensional overlay manufacturing process. It should be noted thata wide variety of overall TPO thicknesses are possible using theseconstruction techniques and several of these variants are provided inthe example embodiments depicted in FIG. 25 (2500)-FIG. 40 (4000).

TPO First Generic Keypad Interface (2500)-(2600)

The present invention may implement the described tactile touch sensorsystem/method in a first generic keypad form as generally depicted inFIG. 25 (2500)-FIG. 26 (2600). This example represents a typical customkeypad interface layout.

TPO Second Generic Keypad Interface (2700)-(2800)

The present invention may implement the described tactile touch sensorsystem/method in a second generic keypad interface form as generallydepicted in FIG. 27 (2700)-FIG. 28 (2800).

TPO Third Generic Keypad Interface (2900)-(3000)

The present invention may implement the described tactile touch sensorsystem/method in a third generic keypad interface form as generallydepicted in FIG. 29 (2900)-FIG. 30 (3000).

TPO First Keyboard Interface (3100)-(3200)

The present invention may implement the described tactile touch sensorsystem/method in a first keyboard form as generally depicted in FIG. 31(3100)-FIG. 32 (3200). These figures depict a flat overlay physicallyaugmenting a force-sensitive touch sensor. In this case, the overlay isa flat piece of flexible material. This overlay has a QWERTY keyboardprinted on it to provide visual feedback to the user.

TPO Second Keyboard Interface (3300)-(3400)

The present invention may implement the described tactile touch sensorsystem/method in a second keyboard form as generally depicted in FIG. 33(3300)-FIG. 34 (3400). Since the TPO overlays may be substituted atwill, the characters on the keyboard face may be replaced depending onthe language desired by the user.

TPO Third Keyboard Interface (3500)-(3600)

The present invention may implement the described tactile touch sensorsystem/method in a third keyboard form as generally depicted in FIG. 35(3500)-FIG. 36 (3600). This embodiment uses thicker key forms than theprevious embodiments and illustrates how the “feel” of the keyboard maybe modified based on the TPO overlay selected. Thus, a single TSA tabletmay support a large number of “feels” for user ergonomics.

TPO First Piano Keyboard Interface (3700)-(3800)

The present invention may implement the described tactile touch sensorsystem/method in a first piano keyboard form as generally depicted inFIG. 37 (3700)-FIG. 38 (3800). This is just an example of a large numberof musical keyboards and musical sampler player keyboards that may beformed as TPO overlays for the TSA tablet interface.

TPO Second Keyboard Interface (3900)-(4000)

The present invention may implement the described tactile touch sensorsystem/method in a second piano keyboard form as generally depicted inFIG. 39 (3900)-FIG. 40 (4000). Here the key relief is higher than in theprevious version and illustrates how the TPO overlay may be configuredin a wide variety of forms to suit the ergonomics of musicians.

Programmable Deformable Membranes (4100)-(4300)

The TPO structure described herein may be constructed using aprogrammable deformable membrane as generally depicted in FIG. 41(4100)-FIG. 43 (4300). These figures depict cross-sections of threedifferent programmable, deformable membranes. In addition to molded andmechanical overlays, one can also use programmable, deformable membranesfor physical touch sensor augmentation. These membranes can beconstructed by embedding elements in a flexible overlay that deform whenactivated, leading to deformation of the overlay itself.

Programmable membranes become very powerful if the system hasprogrammatic control over which deforming elements are active at anygiven time, the application software can dynamically control theappearance and tactile layout of the overlay. This removes the need toactually swap out various overlays in the system. It is possible to havea single programmable membrane that takes on various shapes and providesthe user with different interfaces. For this solution, the membrane canbe laminated directly on the touch sensor surface.

Piezo Deformation (4100)

FIG. 41 (4100) depicts piezo or polymer-based deforming elementsembedded into a flexible overlay. When a voltage is applied to thedeforming elements, the embedded piezo/polymer elements deform. Thisdeformation causes the TPO overlay surface to deform. Deforming elementscan be constructed using piezo elements and/or polymers that deform asvoltage is applied to them.

Air/Fluid/Vacuum Deformation (4200)

Another way to build deforming elements is to embed pockets of air orliquid into the overlay. These pockets are hooked up to a pressurizedpumping system that can control the amount of air/liquid in thesepockets. As air/liquid is pumped into these pockets, the overlay willexpand. As air/liquid is released from these pockets, the overlay willcontract.

FIG. 42 (4200) depicts a deformable membrane system where fluid or gasis pumped into pockets which are embedded in the membrane. The amount offluid/gas pumped in or out of these pockets determines how much the TPOoverlay surface deforms.

Heat Deformation (4300)

A final method for achieving this effect is to embed heat-sensitiveelements that deform when exposed to heat/cold. Heating elements can bebuilt into the overlay in order to activate these deforming elements.

FIG. 43 (4300) depicts a deformable membrane that uses deformingelements that are activated by heat. Heating elements are placed nearthe deforming elements, and current is run through the heating elements.This causes the heating elements to warm up, which causes the deformingelements to expand, which deforms the membrane.

TPO Light Piping (4400)-(4500)

One way to improve the usability of overlays in a dark setting is toilluminate the overlay. For this approach, side-mounted LEDs can beplaced around the bezel of the touch sensor. A TPO overlay can bedesigned such that it functions as a light-guide for theseside-illuminating LEDs. Each overlay can tightly control where lighttravels within the overlay, and also which areas of the overlay appearilluminated or dark. This improves visual feedback to the user, as eachoverlay can use this light-guide technique to highlight specificfunctions presented by the overlay.

The TPO structure described herein may incorporate light piping asgenerally depicted in FIG. 44 (4400)-FIG. 45 (4500). As seen by thesediagrams, lighting of particular portions of the TPO supplied by the TSAtablet structure is provided by side LEDs and optical light pipingwithin the TPO structure.

These figures show how an overlay can be used as a light guide toincrease visibility of the overlay in various environments. Side-mountLEDs can be mounted around the edge of the touch sensor and can shineinto an overlay that is placed on top of the touch sensor. Lightinjected from the side of the overlay can diffuse and exit out ofdesignated areas. As can be seen from the drawings, some areas allowlight to pass through and exit the overlay (these areas will appearilluminated), where other sections are designed to keep light inside theoverlay (these areas will appear dark). Different LEDs can be used toilluminate different sets of TPO structures.

Active TPO Energy Harvesting (4600)-(4700)

So far, overlays have been described as purely passive and unpowered.However, more sophisticated overlays can be created if the overlay canreceive power from the sensor. This is made possible by inductivelypowering the overlays that are placed on the sensor. Depending on theamount of power transferred, these overlays can have powered LEDs,segment-displays, or even play audio through small speakers. Theseoverlays could even have small microcontrollers which are capable oftalking over BLUETOOTH® or BLE to the application software directly.

The modular overlay may contain an inductive coil, capable of receivingpower from an inductive charger. Touch sensors that are transparent tomagnetic fields can be fitted with inductive charging coils to supportcharging/powering these modular overlays.

The TPO structures described herein may implement energy harvesting asgenerally depicted in FIG. 46 (4600)-FIG. 47 (4700). As seen by thesediagrams, collection of energy from the environment and the TSA tabletmay permit electronics within the TPO to perform a variety of functionsin conjunction with activation of pressure to the TSA surface.

Exemplary TSA/TPO Integration (4800)

So far, overlays have been described as monolithic entities, coveringthe entirety of the touch sensor. However, it is equally beneficial tobuild smaller overlays that can be placed in different areas of thesensor. If the bottom of the touch sensor is layered with aferromagnetic material, the magnetic attachment method can be used tomount each overlay reliably to the sensor. If a force-profile, RFID,optical, capacitive, inductive, or resistive identification scheme isimplemented, the various overlays can be identified and tracked acrossthe sensor. This is important so that the software can automaticallyconfigure itself to translate touch data into overlay-dependentfunctional output. With this modular overlay approach, one can mix andmatch flat, 3D, mechanical, and deformable overlays to create new,custom interfaces. These modular overlays are described in more detailin FIG. 65 (6500)-FIG. 128 (12800).

An example of a TSA tablet interfaced with a variety of modular TPOstructures as described herein is generally depicted in FIG. 48 (4800).The surface of the TSA tablet has been reduced in scale for thisillustration but may in some applications be quite large, and includesurfaces having many square feet of surface area. As depicted, the TPOstructures may be aligned in any orientation on the surface and in someapplications with a number of disparate individuals operating the TPOstructures, the TPO structures may be aligned to for a properorientation to each individual cooperating on a singular large TSAtablet.

TSA/TPO Attachment Mechanisms (4900)-(5600)

The TPO structure described herein may be attached to the TSA using avariety of techniques as generally depicted in FIG. 49 (4900)-FIG. 56(5600). There are many different ways to couple an overlay with a touchsensor. The simplest method is to simply place the overlay on top of thesensor. However, this method is not very reliable as the overlay is freeto move around. The following sections describe better methods forattaching sensor overlays.

TPO Peripheral Edge Insertion into TPA (4900)-(5000)

A touch sensor housing can be constructed so that its bezel is rigid buthas enough overhang to hold an overlay in place. FIG. 49 (4900)-FIG. 50(5000) shows how an overlay can be integrated into such a design. Asgenerally depicted in FIG. 49 (4900)-FIG. 50 (5000), the TPO (4910) maybe flexed to allow peripheral edge insertion into the bezel covering theTSA (4920). This insertion sequence is detailed in FIG. 50 (5000)wherein the TPO (5010) edges are inserted into recesses (5021) in thebezel (5022) covering the TSA surface.

As discussed above, a bezel can be designed to hold an overlay withouthinges or magnets. This configuration may incorporate a rigid bezeldesigned to have an overhang capable of holding a flexible overlay. Inthis configuration, an overlay can be folded and slid into the housingsuch that the overlay edges fall beneath the bezel overhang. Thisconfiguration works for flexible overlays, but not for rigid overlays.

TPO Side Edge Insertion into TPA (5100)-(5200)

A touch sensor housing can be constructed so that its bezel is rigid buthas enough overhang to hold an overlay in place. FIG. 51 (5100)-FIG. 52(5200) shows how an overlay can be integrated into such a design. Asgenerally depicted in FIG. 51 (5100)-FIG. 52 (5200), the TPO (5110) maybe configured to permit side edge insertion into the bezel covering theTSA (5120). Within this TPO attachment embodiment as detailed in FIG. 52(5200) the TSA bezel may be configured have closed ends (5222) or to beopen ended (5223). While the depiction in FIG. 51 (5100) depicts aclosed-ended bezel (5222) configuration, the open-ended bezel (5223)configuration may be substituted with no loss of invention scope.Depending on the embossed key height of the TPO (5110), the choice ofthe bezel type will be application specific and in some circumstancesthe bezel may be mated with the TPO as separate or unitary structures.

FIG. 51 (5100)-FIG. 52 (5200) shows an attachment solution that worksfor both flexible and rigid overlays. This touch sensor housing has arigid bezel on three sides. This allows a sensor to be slid into thehousing. Optionally, a bezel can be snapped into place to secure theoverlay on the side from which it was inserted into the housing. Detailsof this snap attachment feature are not shown but one skilled in the artwill recognize that many plastic snap attachment methodologies arecompatible with this embodiment teaching.

TPO Magnetic Bezel Attachment to TPA (5300)-(5400)

It is also possible to attach an overlay to a touch sensor with magnets.These magnets can be placed in the bezel of a device to help withsensor/overlay alignment. A touch sensor housing can also be constructedso that the bezel completely detaches from the housing. This is similarto the hinged frame approach, except that both sides detach. With adrop-in frame, the bezel can either snap into the sensor housing orconnect via magnets to the top of the overlay.

As generally depicted in FIG. 53 (5300)-FIG. 54 (5400), the TPO (5310)may be configured to permit attachment to the TSA (5320) using a TPOmagnetic retention bezel (5330). These figures show how a drop-in frame(5330) can be used to secure an overlay to a touch sensor. A drop-inframe may use either magnets or plastic snaps/indents in order tosecurely couple to the sensor housing. A TPO overlay can be placed ontop of the touch sensor, and the drop-in frame will come down on top ofthe overlay to secure it to the touch sensor.

Magnets (5321) contained within the TSA (5320) mate with correspondingmagnets (5431) within the magnetic TPO retention bezel (5430). The TPO(5310, 5410) depicted in these drawings is designed to be retained atthe edges by the TPO magnetic retention bezel (5330, 5430).

TPO Attachment Using Thru-Hole Magnets (5500)-(5600)

As generally depicted in an alternate embodiment depicted in FIG. 55(5500)-FIG. 56 (5600), other variants of this construction technique mayincorporate holes (5511) in the TPO (5510, 5610) corresponding to TSA(5520, 5620) magnets (5521) and magnets (5531) in the TPO magneticretention bezel (5530, 5630) such that retention of the TPO (5510, 5610)is accomplished by the magnets (5521, 5531) at the corners of the TPO(5510, 5610) and TPO magnetic retention bezel (5530, 5630). This variantrequires a larger footprint for the TPO (5510, 5610) that allows overlapof the magnets (5521, 5531) at the corners of the TPO (5510, 5610), TSA(5520, 5620), and TPO magnetic retention bezel (5530, 5630).

TPO Hinged Bezel Attachment to TPA (5500)-(5600)

A touch sensor housing can be constructed so that an area of the bezelopens up on hinges. An overlay can be placed on the touch sensor, andthe bezel can be closed back down, securing the overlay to theunderlying sensor. As generally depicted in FIG. 55 (5500)-FIG. 56(5600), the TPO (5510) may be configured to permit attachment to the TSA(5520) using a TPO hinged retention bezel (5530). Hinges (5621)contained within the TSA assembly (5620) mate with corresponding hingeelements (5631) within the TPO retention bezel (5630). As withpreviously described embodiments, the TPO retention bezel (5630) may besecured to the TSA assembly (5620) using magnets that may be placed atone or more of the assembly corners as depicted. Some alternateembodiments may utilize a latching mechanism on the front of the TSAassembly (5620) to secure the TPO retention bezel (5630).

FIG. 55 (5500)-FIG. 56 (5600) show how a hinged frame can be used tosecure an overlay to a touch sensor. To install an overlay, one simplyopens up the frame, lays a new overlay on top of the touch sensor, andclose the frame. The overlay will extend underneath the hinged frame soit will be securely held against the touch sensor. The hinged frame maybe secured on one side via hinges and can be secured on the other sidewith magnets. Note that the touch sensor is integrated into this housingand is not removable (only the overlay is removable). The hinged framemay be secured with a hook/catch system instead of magnets. Springs canbe used to pop open the hinged frame when the hook is slid open. Withthis construction, the hinges may also be replaced with tabs to create aremovable frame.

TPO Identification Mechanisms (5700)-(6400)

Overview

As mentioned previously in the SOFTWARE section, it is important to keepapplication software “in sync” with the TPO overlay that is currently ontop of the TSA sensor. If software is mismatched with the overlay, theoverlay will not function as the user expects. It can be a difficulttask to constantly make sure that the application software is matchedwith the current overlay. One way to solve this problem is to build asystem where the software can check to see which overlay is currently onthe touch sensor. Methods for achieving this functionality are describedin the following sections.

FIG. 57 (5700)-FIG. 64 (6400) show how an overlay can be constructed sothat the sensor can detect which overlay is presently placed on top ofthe sensor. A dot pattern being used with the force profile overlayidentification method. An overlay with an embedded RFID tag may also beused. As described earlier, the touch sensor can be constructed with anRFID reader capable of reading an ID from this tag. Also, an RFID tagcan be replaced with an antenna and generic microcontroller that isprogrammed to modulate the electromagnetic waves sent from the RFIDreader. The microcontroller can receive power from the RFID reader andrespond to ID requests. Optical identification of the TPO is using abarcode and/or QR code is also anticipated. A conductive pattern mayalso be used for identification using capacitance, conductance, orinductance measurement. It should be noted that the optical andcapacitive identification markers can be placed on either side of theoverlay. These marks could also be placed on the edge of the overlay aswell. The marker position depends on how the ID sense electronics arepositioned within the sensor housing.

The TPO structure in many preferred invention embodiments mayincorporate some form of unique identification mechanism as generallydepicted in FIG. 57 (5700)-FIG. 64 (6400). These TPO unique identifiers(TPI) permit software controlling the TSS to automatically reconfigureoperation when a given TPO is applied to the surface of the TSA. Avariety of TPI identification methodologies are anticipated by thepresent invention and will now be discussed.

Exemplary TPO/TSA Assembly (5700)

FIG. 57 (5700) illustrates an exemplary TPO (5710) that has beenconfigured to mate with a TSA tablet (5720). This exemplary TSA+TPOconfiguration will be used as the baseline example for the various TPOidentification methodologies described below.

Embedded TPO Magnets (5800)

FIG. 58 (5800) illustrates the use of embedded magnets in the TPO touniquely identify the TPO when placed on the TSA. Here the magnets maybe positioned within the TPO to mate to corresponding magnets embeddedin the TSA (not shown). This allows the TPO structure to be positivelymated to the TSA surface allowing registration alignment of the TPO andthe TSA surface. This figure shows how magnets can be embedded in anoverlay itself. If the touch sensor housing has complementary magnets inthe same positions, the overlay can be directly attached to the top ofthe sensor.

TPO Magnetic Identification (5900)

FIG. 59 (5900) illustrates a TPO structure (5910) incorporating TPOpositioning magnet locations (5911) as described above and alsoincorporating a number of TPI identification magnet locations (5912)which may be populated with magnets that are detected by correspondingmagnetometers (e.g., Hall effect sensors or equivalent detectors) withinthe TSA. By selectively populating the TPI identification magnetlocations (5912), the TSA magnetometers may identify a bit stream thatis unique to the particular TPO and thus load appropriate softwaredrivers and application software to process information received fromthe depression pressures sensed by the TSA. This identificationmechanism can also be utilized without the use of magnetometers byembedding corresponding magnets for each of the TPI identificationmagnet locations (5912) within the TSA and measuring the pressuresdetected at each TPI location. TPI positions that do not have magnetsinstalled will register little or no detected pressure whereas TPIlocations in the TPO that have magnets installed will detect ameasureable increase in TSA pressure that can be converted to acorresponding TPI identification bit stream.

Raised TPO Pressure Indicia (Force-Profile Identification) (6000)

Since the overlays are placed against a force-sensitive touch sensor, itis possible to modify an overlay so that it exerts a unique forceprofile against the sensor. It is possible to form this force profile sothat it is unique, which will allow the software to distinguishdifferent overlays from each other. FIG. 60 (6000) shows one way toachieve this by placing small protrusions on the bottom side of theoverlay. These protrusions will push into the touch sensor, creating adetectable force profile pattern. A scheme can be generated where alloverlays have a designated region of the sensor where these protrusionsare present. If this is the case, one can use a binary encoding toassign a unique ID to each overlay. The presence of a protrusion can mapto a “1” and the absence of a protrusion can be a “0.” This binaryscheme can be decoded into an overlay ID. When a new overlay is placedon the sensor, the sensor can read the ID of the new overlay, andintelligently load the correct software that matches the functionalitypresented in the overlay.

As an example, FIG. 60 (6000) illustrates a TPO structure (6010)incorporating TPO positioning magnet locations (6011) as described aboveand also incorporating a number of raised TPI identification indicialocations (6012) which may incorporate a variety of shapes that areraised above the plane of the TPO and which exert a defined pressureprofile on the surface of the TSA. By providing the correct shape and/orposition at the TPI identification indicia locations (6012), the TSA caninspect this area of the pressure-sensitive surface and determine theidentification of the TPO (6010) by virtue of the unique pressureprofiles presented above the back surface plane of the TPO (6010). Notehere that the pressure profile shape and/or position of the TPIidentification indicia locations (6012) may be used in thisidentification process. Thus a particular shape may uniquely identifythe TPO and/or a binary encoding of data from the pressure profile maybe used to accomplish this identification. It should be noted that thistechnique of identification by the use pressure profile perimeterinformation can also be used with the magnetic approach detailed in FIG.59 (5900).

Further examples of the use of pressure indicia identification for TPOstructures is depicted in more detail in FIG. 121 (12100)-FIG. 125(12500) with a corresponding method identification provided in theflowchart of FIG. 128 (12800).

Tactile Bar Code Identification (6100)-(6200)

FIG. 61 (6100)-FIG. 62 (6200) illustrate the use of a tactile bar code(6112) to identify the TPO (6110). This pressure-sensitive approach issimilar to that described in FIG. 60 (6000) and optionally incorporatesregistration magnets (6111) with the exception that the tactile bar code(6112) typically contains sufficient internal registration informationsuch that it can be placed on any position on the TPO and still beproperly recognized by the TSA without the need for registration magnets(6111). In some circumstances the TPO recognition process may beenhanced by “swiping” the TPO to press the bar code onto the surface ofthe TSA and thus affect identification of the bar code by the TSAscanning logic. Also depicted in FIG. 61 (6100) is the use of araised-texture quick response (QR) code (6113) that may also be used ina similar fashion as the illustrated bar code to provide TPOidentification information and possibly source information forapplication software and/or drivers for the TPO configuration.

Optical Identification (6100)-(6200)

Alternatively, optical solutions can be employed to identify overlaysthat are lying on top of the sensor. For instance, barcodes or QR codesmay be placed on the bottom side of TPO overlays (FIG. 61 (6100)-FIG. 62(6200)). The TSA force sensor may be equipped have a barcodescanner/camera that reads the unique bar/QR code and determines whatparticular TPO overlay is on top of the sensor. It is also possible touse a mounted camera looking down on the TSA sensor to identifydifferent overlays.

TPO RFID Identification (6300)

Another way to identify which overlay is on top of the sensor is toembed an RFID tag into each overlay. As long as the touch sensor istransparent to magnetic fields, an RFID antenna can be placed directlyunderneath the touch sensor. This antenna can be connected toelectronics capable of reading the RFID tag in the overlay. For moldedoverlays, an RFID tag can be embedded into the mold itself. Formechanical and deformable overlays, the RFID tag can be placed on thebottom of the overlay. Care must be taken so that the RFID layercontinues to allow the transmission of forces to the underlying touchsensor.

FIG. 63 (6300) illustrates a TPO (6310) incorporating a RFID (6312)embedded within the TPO (6310) that may passively communicate theidentification of the TPO (6310) to a corresponding RFID communicationinterface present within the TSA. One skilled in the art will recognizethat the form factor of the RFID (6312) may vary widely based onapplication context and choice of particular RFID technology. The RFID(6312) may be a separate component as illustrated or in some preferredembodiments it may be incorporated within the internal construction ofthe TPO (6310).

TPO Shorting Bar Identification (6400)

FIG. 64 (6400) illustrates a TPO (6410) mated with a TSA (6420) whereinthe TPO identification occurs as a result of shorting bars (6412)present in the TPO (6410) that mate with corresponding switch contacts(6422) in the TSA (6420) surface. Proper placement of shorting bars(6412) on the TPO (6410) allows a binary code to be interpreted by theTSA (6420) and identification of the TPO (6410) to occur.

TPO Capacitive and/or Inductive Identification (6400)

Additionally, conductive electrodes can be attached, printed, orembedded into the TPO overlay. An array of capacitance and/or inductancesensors can be placed along the edge of the touch sensor. Thesecapacitance and/or inductance sensors can detect the presence/absencesof these electrodes. Once again, these electrodes can be used as abinary encoding to distinguish different overlays.

As an example, other variants of the configuration depicted in FIG. 64(6400) may use capacitive and/or inductive coupling differentialsbetween the contacts (6422) in the TSA (6420) and the correspondingconductive bars (6412) present in the TPO (6410) to detect changes incapacitance and/or inductance as the TPO (6410) is mated to the TSA(6420) to identify the encoded TPO identification by thepresence/absence of the conductive bars (6412) present in the TPO(6410). These changes in capacitance and/or inductance may be detectedusing differentials in conductive materials on the surface or embeddedwithin the TPO.

Exemplary TPO Detection Hardware

While a number of hardware approaches may be taken to affect automaticdetection of TPO overlays, the following list of exemplary non-exclusivehardware provides typical interfacing hardware that may be used withmany invention embodiments.

Capacitive Detection

-   -   ANALOG DEVICES model AD7147A—CapTouch Programmable Controller        for Single-Electrode Capacitance Sensors.    -   ATMEL model AT42QT2120—QTouch 12-channel Touch Sensor IC.        Inductive Detection    -   TEXAS INSTRUMENTS model LDC1000 Inductance-to-Digital Converter.    -   TEXAS INSTRUMENTS model LDC1312/1314—Multi-Channel 12-bit        Inductance to Digital Converter (LDC) for Inductive Sensing.        Magnetic Detection    -   TEXAS INSTRUMENTS model DRV5053—Analog-Bipolar Hall Effect        Sensor.    -   TOSHIBA model TCS20DLR—CMOS Digital Integrated Circuit Silicon        Monolithic Digital Output Magnetic Sensor.

Exemplary TPO Forms

The following discussion details a variety of anticipated exemplary TPOforms. One skilled in the art will no doubt be able to expand on thesefunctional forms to include a wide variety of structures using theteachings presented. While the forms presented have been providedexaggerated horizontal and vertical dimensions for the purposes ofillustrating the concepts herein, these dimensions and proportions arenot limitive of the invention scope. Many application contexts willincorporate the functionality of the disclosed TPO structures but in amore compact form factor to support thin custom console structures orpredefined console interfaces having a thin portable form factor.

Mechanical Overlays

The previously discussed types of overlays (flat and 3D) both requirethe use of flexible materials in order to effectively transmit forcesfrom the user to the touch sensor. There is a way, however, to build anoverlay with rigid materials. This type of overlay is referred to in theinvention disclosure as a mechanical overlay. This type of overlay canbe made of any material, as long as it effectively translates user inputof interest through to the underlying touch sensor. For instance, anoverlay with a physical button, switch, knob, slider, and joystick couldbe constructed such that interaction with these features translates todistinguishable input on the touch sensor. Examples of mechanical TPOoverlays are depicted in FIG. 65 (6500)-FIG. 104 (10400) and describedin detail below.

FIG. 65 (6500)-FIG. 104 (10400) depict an examples of mechanicaloverlays. In these examples, no flexible materials are used. Instead,mechanical widgets (sliders, knobs, toggle switches, and buttons) aredesigned such that they transmit forces from a user's input to theunderlying touch sensor. The various views show the mechanical overlaycross-sections, and depict how slider and a button are implemented inthese embodiments. The slider is constructed so that the bottom of thesliding element is always in contact with the touch sensor. This allowsthe sensor to continually read a slider position, which is updated whenthe user moves the slider back and forth. The button, on the other hand,does not touch the sensor by default. When a user presses the button,the touch sensor is able to detect the button activation by sensing theforce exerted by the traveling button shaft.

These figures show how modular overlays can be created. These overlayseach contain magnets and can be mounted to a touch sensor that has aferromagnetic material behind it. This allows the overlays to be placedanywhere on the touch sensor. In some circumstances the implementationof a flat, flexible, modular overlay is anticipated. This overlay can beused to indicate generic touch input, or could indicate that a certainregion of the sensor is designated for drawing. In the latter case, thetop material of this overlay could be specially selected to enhance thewriting experience. FIG. 48 (4800) and FIG. 126 (12600)-FIG. 127 (12700)show what a touch sensor might look like when it is populated with avariety of different modular overlays. Since these overlays aremagnetic, they can be rearranged in any way. This allows a user tocreate custom, powerful, yet intuitive physical interfaces.

TPO Pushbutton (6500)-(6800)

The present invention may in some preferred embodiments be implementedin a TPO pushbutton form as generally depicted in FIG. 65 (6500)-FIG. 68(6800). This general type of pushbutton may have a wide variety offorms, but as illustrated incorporates magnets at the four bottomcorners of the device and a spring-loaded pressure contact thatinitiates a pressure reading on the TSA.

TPO Rocker Switch (6900)-(7200)

The present invention may in some preferred embodiments be implementedin a TPO rocker switch form as generally depicted in FIG. 69 (6900)-FIG.72 (7200). The embodiment illustrated provides for four magnets tosecure the rocker switch to the TSA and a two position rocker thatarticulates a spring-loaded contactor that provides pressure to thesurface of the TSA. A ball bearing may be incorporated as shown toreduce the frictional drag associated with the change in rocker switchposition.

TPO Slider (7300)-(7600)

The present invention may in some preferred embodiments be implementedin a TPO slider form as generally depicted in FIG. 73 (7300)-FIG. 76(7600). This slider provides an analog linear contactor that has onedegree of freedom in movement. This may implement a variety of linearand digital inputs as interpreted by the TSA pressure sensor.

TPO Knob (7700)-(8000)

The present invention may in some preferred embodiments be implementedin a TPO knob form as generally depicted in FIG. 77 (7700)-FIG. 80(8000). The TPO knob embodiment operates in a manner similar to that ofthe slider with the exception that a rotating knob indicator is used toprovide radial pressure to the TPA about the rotational axis of theknob. Spacing foam washers and a retaining fastener provide thenecessary friction to maintain the knob position once rotated. As withthe slider, a spring-actuated contactor with optional ball bearingcontact point provides the TPA pressure necessary to detect the knobdisplacement.

The knob as indicated provides for fully linear circular travel about anaxis of rotation. However, it is possible to incorporate detents in thepositioning mechanism to provide for a rotary switch function ascompared to a traditional potentiometer functionality.

TPO Mouse/Puck (8100)-(8800)

The present invention may in some preferred embodiments be implementedin a TPO mouse/puck form as generally depicted in FIG. 81 (8100)-FIG. 88(8800). This exemplary TPO embodiment depicts a two-piece mouse/puckassembly in which the mouse/puck shell (8510) is mated to a replaceablecontact surface plate (8520) that makes pressure contact with the TSAsurface via protrusions on its bottom surface. As generally depicted inFIG. 85 (8500), the mouse/puck shell (8510) is designed to receive acorrespondingly indexed replaceable contact surface plate (8520) via asliding channel extruded within the body of the mouse/puck shell (8510).

As indicated in the variants depicted in FIG. 87 (8700)-FIG. 88 (8800),the contact surface plate may be configured in a wide variety of ways toprovide a number of different pressure patterns that uniquely identifythe mouse/puck. Of course, it would be possible to generate single-piecemouse/puck configurations using these teachings. However, the ability toselect an ergonomic mouse shell (8510) and reconfigure this with anumber of replaceable contact surface plates (8520) allows a greatdegree of freedom for the user when interfacing with software such asgaming applications and the like.

The formations of the mouse/puck TPO as depicted in FIG. 81 (8100)-FIG.88 (8800) permit lateral pressure differentials on the top of themouse/puck to be translated to sensed pressure differentials on the TSA.For example, as pressure is redistributed among the various surfacecontact pads (8521, 8522, 8523) on the bottom of the replaceable contactsurface plate (8520), this may be interpreted by software as equivalentmouse clicks or other GUI messaging information. Other contact padformations as depicted in FIG. 88 (8800) permit pressure differentialsto be detected in two or more axes, depending on the number and type ofcontact pads provided on the bottom surface of the contact plate.Variations in the number and placement of various contact pointsprovides for a wide variety of actions associated with user inputactivity.

TPO Joystick (8900)-(9600)

The present invention may in some preferred embodiments be implementedin a TPO joystick form as generally depicted in FIG. 89 (8900)-FIG. 96(9600). These diagrams disclose a joystick that may be mated to the TSAsurface via magnetic attraction and allow the joystick to be articulatedin a wide variety of positions. The contact point between the TSA andthe joystick may optimally be a spring loaded contactor having anoptional integrated ball bearing. As generally depicted in FIG. 95(9500)-FIG. 96 (9600), the joystick may also incorporate a spring-loadedpushbutton (and corresponding pressure contact shaft) that may act as aselector at a given joystick position. This action may mimic thefunction of a mouse key. As the coordinate position of the joystick is anon-linear function of the joystick radial angle, software may be usedto correct the relationship between the measured TSA pressure positionand the user-positioned angle of the joystick.

TPO Trackpad (9700)-(10000)

The present invention may in some preferred embodiments be implementedin a TPO trackpad form as generally depicted in FIG. 97 (9700)-FIG. 100(10000). This form of TPO may have special indicia or other tactileforms on the surface of the TPO that are application specific. As such,it represents a very generic method of incorporating software-specificfunctionality into the TSA.

TPO Keypad (10100)-(10400)

The present invention may in some preferred embodiments be implementedin a TPO keypad form as generally depicted in FIG. 101 (10100)-FIG. 104(10400). Here the TPO trackpad described above may be augmented with acustom overlay and associated custom indexed pressure contactor (IPC)that is configured with contact points associated with each key in thekeypad overlay.

Flat Overlays (10500)

The simplest form of physical touch sensor augmentation is achieved witha flat, flexible overlay. This overlay can be printed with markings thatindicate different sensor functions. For instance, a QWERTY keyboardoverlay could just be a thin, flexible plastic membrane with a keyboardpattern printed on its top surface. When placed on a sensor, the sensorcan turn into a functional keyboard, capable of turning touch data intokeyboard keystrokes (assuming the correct software is also enabled). Theoverlay provides visual feedback to the user, increasing usability ofthe keyboard functionality. Various examples of these flat TPO overlayswith a number of tactile surface patterns are depicted in FIG. 105(10500).

TPO Trackpad/Keypad Overlay Construction (10500)-(11200)

The present invention may implement TPO trackpad/keypad overlays in awide variety of as generally depicted in FIG. 105 (10500)-FIG. 112(11200). The examples provided in these figures are depicted in a squareconfiguration, but can be constructed with any type of perimeter form.Additionally while nine keys are depicted in the diagrams, the presentinvention may incorporate any number of keys in based on applicationcontext. Keys represented in the figures incorporate embossed indicia,but this is not a limitation of the present invention.

These figures depict overlay cross-sections of various features that aremade possible with the use of a three-dimensional, flexible overlay.Texture can be added to provide the user with tactile feedback. It isalso possible to add indentations or ridges around features to increaseusability. It is also possible to create standalone raised/loweredbuttons. Subtle indicators can be implemented with small, raised bumps.Finally, dome-switch buttons can be molded with a three-dimensionaloverlay to give users a button “feel” when using the device.

FIG. 105 (10500) depicts a basic flat trackpad/keypad overlay that mayor may not have printed text and/or key surface texturing associatedwith its construction. FIG. 106 (10600) depicts a trackpad/keypadoverlay that incorporates edge indentations around buttons/keys. FIG.107 (10700) depicts a trackpad/keypad overlay that incorporates edgeridges around buttons/keys. FIG. 108 (10800) depicts a raised key/buttontrackpad/keypad overlay. FIG. 109 (10900) depicts a depressed/loweredkey/button trackpad/keypad overlay. FIG. 110 (11000) depicts adepressed/lowered key/button trackpad/keypad overlay with raised bumpindicia.

FIG. 111 (11100) depicts a domed key/button trackpad/keypad overlay.FIG. 112 (11200) depicts a domed key/button trackpad/keypad overlay withkey caps. With a 3D overlay, it is possible to make the backside of theoverlay non-flat. This allows the overlay to control the level of forcesrequired to activate the sensor. For instance, a dome switchconstruction can be created, so that a minimum level of force isrequired to actually transmit forces through to the sensor (FIG. 111(11100)-FIG. 112 (11200)).

Modular TPO Construction (11300)-(12000)

The present invention may in some preferred embodiments implement a TPOin modular construction form as generally depicted in FIG. 113(11300)-FIG. 120 (12000). These exemplary embodiments incorporatesymmetric latch-and-clasp mechanisms along the X-axis and Y-axis of theTPO structure. These symmetric latch-and-clasp structures allow avariety of TPO structures to be mated and placed on a TSA to form anintegrated tactile touch sensor interface to the TSA.

As depicted in the single key diagrams of FIG. 113 (11300)-FIG. 116(11600), each TPO structure incorporates horizontal/verticallatch-and-clasp male portions that mate with corresponding femaleportions in adjacent TPO structures. As indicated in FIG. 116 (11600),these latch-and-clasp male portions may be trimmed or cut off at theperipheral edges of TPO arrays containing these structures for aestheticpurposes. When corresponding male and female latch-and-clasp portionsare mated, a unified TPO structure may be formed in which a variety ofTPO structures as defined here may be combined to form a singularinterface to the TSA. A 3×3 example of this is provided in FIG. 117(11700)-FIG. 120 (12000).

Auto-Identified Modular TPO Construction (12100)-(12800)

The present invention may in some preferred embodiments implement a TPOwith integrated automatic identification mechanisms as generallydepicted in FIG. 121 (12100)-FIG. 128 (12800). These exemplaryembodiments incorporate TPO identifier (TPI) bit-based identificationcodes on the bottom of each TPO that is sensed by the TSA when the TPOis magnetically attached to the surface of the TSA. In this manner,software interrogating the TSA may look for particular pressure bitsequences on the surface of the TSA and automatically identify the typeof TPO located at that particular TSA position. This automatic TPOidentification may then load appropriate software drivers and/orapplication software automatically without the need for userintervention.

While the exemplary TPO structures depicted in FIG. 121 (12100)-FIG. 128(12800) utilize the modular TPO connection features described above, theautomatic identification of TPO structures based on pressure sensing bythe TSA of encoded bit patterns does not require this feature. However,it is thought that the embodiment in these figures represents apreferred embodiment of the present invention.

Exemplary TSA+TPO Assembled Keyboard (12600)-(12700)

As generally depicted in FIG. 126 (12600)-FIG. 127 (12700), thetechniques described above may be used to assemble keyboards ofarbitrary configuration by simply placing the TPO elements on thepressure sensitive TSA surface. When combined with the automaticidentification feature, the TPO arrays present a powerful method togenerate custom keyboard structures by simply mating an arbitrary numberof different TPO overlays in a user-defined array pattern. Placing theTPO array on the TSA then automatically configures the software with theappropriate application software and drivers necessary to properlyinterpret each individual TPO overlay based on the TPI identificationread by the TPD within the TSA.

Exemplary TSA+TPO Identification Method (12800)

The above-described automatic TPO identification indicia may in manyinvention embodiments be associated with an automatic TPO identificationmethod. As generally depicted in the flowchart of FIG. 128 (12800), anexemplary present invention automatic TPO identification method can begenerally described as comprising the steps of:

-   -   (1) Encoding a TPO overlay ID as a TPO bit-based physical        identifier (TPI) on bottom surface of a TPO (12801);    -   (2) Applying the auto-identified TPO to a TSA surface (12802);    -   (3) Scanning the surface of the TSA to locate pressures points        associated with the auto-identified TPO (12803);    -   (4) Determining if new TPO pressure points have been detected on        the TSA surface, and if not, proceeding to step (10) (12804);    -   (5) Locating a TPI pressure registration pattern (TRP)        indicating auto-ID field on the surface of the TSA (12805);    -   (6) Locating the TPO ID field (TPI) using the location of        identified TRP registration pattern (12806);    -   (7) Decoding the located TPI field on the surface of the TSA        from binary pressure points within the TPI to a TPI index (TPX)        value (12807);    -   (8) Retrieving TPO support software for the currently detected        TPO from an application/driver software database (12811) with        TPX index as the lookup indexing key (12808);    -   (9) Presenting a software application/user interface to a user        using TPX-indexed software loaded from the application/driver        software database (12811) (12809);    -   (10) Interpreting TSA inputs from TPOs placed on the surface of        the TSA based on existing or dynamically loaded software        drivers/applications loaded from the application/driver software        database (12811) and proceeding to step (3) (12810).        This general method may be modified heavily depending on a        number of factors, with rearrangement and/or addition/deletion        of steps anticipated by the scope of the present invention.        Integration of this and other preferred exemplary embodiment        methods in conjunction with a variety of preferred exemplary        embodiment systems described herein is anticipated by the        overall scope of the present invention.

Preferred Embodiment System Summary

The present invention preferred exemplary system embodiment anticipatesa wide variety of variations in the basic theme of construction, but canbe generalized as a tactile touch sensor system comprising:

-   -   (a) touch sensor array (TSA); and    -   (b) TSA pressure overlay (TPO);    -   wherein:    -   the TSA comprises a pressure-sensitive surface (PSS)        incorporating row-column force detection;    -   the TPO comprises a pressure contact surface (PCS);    -   the TPO overlays the PSS;    -   the TPO is configured to transmit pressure to the PSS via the        PCS;    -   the TSA is configured to determine if the TPO is present on the        PSS;    -   the TSA comprises a TPO detector (TPD) configured to detect an        identification (TPI) of the TPO; and    -   the TSA is configured to interpret the transmitted pressure        based on the detected TPI of the TPO.

This general system summary may be augmented by the various elementsdescribed herein to produce a wide variety of invention embodimentsconsistent with this overall design description.

Preferred Embodiment Method Summary

The present invention preferred exemplary method embodiment anticipatesa wide variety of variations in the basic theme of implementation, butcan be generalized as a tactile touch sensor method comprising:

-   -   (1) Encoding an overlay identification (TPI) within a touch        sensor physical overlay (TPO) incorporating a pressure contact        surface (PCS) to uniquely identify a function of the TPO;    -   (2) Overlaying the TPO to a surface of a touch sensor array        (TSA) comprising a pressure-sensitive surface (PSS)        incorporating row-column force detection to allow the        transmission of pressure to the PSS via the PCS;    -   (3) Reading the TPI with a TPO detector (TPD);    -   (4) Interrogating the TPI via a hardware computer interface        (HCI) using a user computing device (UCD);    -   (5) Loading an application software driver (ASD) on the UCD        based on the TPI read by the TPD;    -   (6) Presenting a software application/interface to a user based        on the TPI read by the TPD;    -   (7) Interpreting inputs from the TSA inputs through the HCI        based on the TPI read by the TPD; and    -   (8) Proceeding to step (6) if the ISO has not been modified or        replaced and proceeding to step (2) if the TPD has detected a        change in the TPO placed on the TSA.        One skilled in the art will recognize that these method steps        may be augmented or rearranged without limiting the teachings of        the present invention. This general method summary may be        augmented by the various elements described herein to produce a        wide variety of invention embodiments consistent with this        overall design description.

System/Method Variations

The present invention anticipates a wide variety of variations in thebasic theme of construction. The examples presented previously do notrepresent the entire scope of possible usages. They are meant to cite afew of the almost limitless possibilities.

This basic system and method may be augmented with a variety ofancillary embodiments, including but not limited to:

-   -   An embodiment wherein at least a portion of the TPO is        transparent.    -   An embodiment wherein at least a portion of the TPO is        translucent.    -   An embodiment wherein the TPO is formed via a manufacturing        process selected from a group consisting of: injection molding;        3D printing; embossing; laser-cutting from blank overlays; and        laser-cutting from stock overlay materials.    -   An embodiment wherein the TPO comprises material selected from a        group consisting of: Rogers Corporation PORON® brand        microcellular urethane; urethane; urethane foam; silicone;        silicone foam; neoprene foam; rubber; thermoplastic polyurethane        (TPU); and transparent overlay material retaining a printed        sheet of paper.    -   An embodiment wherein the TPO comprises a flexible overlay.    -   An embodiment wherein the TPO comprises a flexible overlay        comprising a textured surface.    -   An embodiment wherein the TPO comprises a flexible overlay        comprising a key/button feature selected from a group consisting        of: key/button with surface texturing; key/button with edge        indentations;    -   key/button with edge ridges; key/button with raised overlay;        key/button with depressed/lowered overlay; key/button with        raised bump indicia; key/button with domed overlay; and        key/button with domed overlay and key caps.    -   An embodiment wherein the TPO comprises a rigid mechanical        overlay.    -   An embodiment wherein the TPO comprises a keyboard selected from        a group consisting of: QWERTY keyboard; DVORAK keyboard;        court-stenographer keyboard; numeric keypad keyboard; piano        keyboard; musical instrument keyboard; and musical sampler        player keyboard.    -   An embodiment wherein the TPO is configured to exert a unique        force profile when contacting the TSA.    -   An embodiment wherein the TPO further comprises a radio        frequency identification (RFID) tag incorporating the TPI.    -   An embodiment wherein the TPO further comprises an optical TPI        readable by the TPD, the optical TPI selected from a group        consisting of: bar code; QR code; and text.    -   An embodiment wherein the TPO is attached to the TSA via the use        of one or more magnets.    -   An embodiment wherein the TPO is attached to the TSA using a        mechanism selected from a group consisting of: peripheral edge        insertion; side edge insertion; magnetic bezel; and hinged        bezel.    -   An embodiment wherein the TPI is determined by the TPD via the        detection of magnets positioned in the TPO.    -   An embodiment wherein the TPI is determined by the TPD via the        detection of surface protrusions present within the PCS.    -   An embodiment wherein the TPI is determined by the TPD via the        presence of a radio frequency identification (RFID) tag in the        TPO.    -   An embodiment wherein the TPO comprises a physical pressure        generation device selected from a group consisting of: slider;        knob; toggle switch;    -   pushbutton switch; joystick; joystick/pushbutton combination;        and mouse/puck.    -   An embodiment wherein the TPO comprises a mouse/puck for which        position, rotation, and/or differential tilt pressure applied by        the mouse/puck to the PSS is sensed by the TSA.    -   An embodiment wherein the TPO comprises a mouse/puck further        comprising a mouse/puck shell is mated to a replaceable contact        surface plate.    -   An embodiment wherein the TPD comprises a detector selected from        a group consisting of: magnetometer; radio frequency        identification (RFID) tag reader; radio frequency identification        (RFID) tag array reader; camera; optical sensor; capacitance        sensor; inductive sensor; and conductance sensor.    -   An embodiment wherein the TPO further comprises conductive        electrodes configured to present a predetermined capacitance        profile to a selected region of the TSA.    -   An embodiment wherein the TPO further comprises conductive        electrodes configured to present a predetermined conductance        profile to a selected region of the TSA.    -   An embodiment wherein the TPO further comprises conductive        electrodes configured to present a predetermined inductance        profile to a selected region of the TSA.    -   An embodiment wherein the TPO comprises symmetric        latch-and-clasp mechanisms along an X-axis and Y-axis of the TPO        to permit formation of modular combinations of a plurality of        TPO structures.    -   An embodiment wherein the TSA further comprises a hardware        computer interface (HCI) configured to interact with a user        computing device (UCD) to automatically load application        software driver (ASD) on the UCD in response to detection by the        TPD of the TPI associated with the TPO.    -   An embodiment wherein the TPO further comprises a programmable        deformable membrane that is activated from a deformation        actuator selected from a group consisting of: piezo-electric        element; pneumatic element; and heating element.    -   An embodiment wherein the TPO is configured to accept side        illumination from a light source within the TSA.    -   An embodiment wherein the TPO is configured to collect        electrical energy via the use of a power harvesting coil.

One skilled in the art will recognize that other embodiments arepossible based on combinations of elements taught within the aboveinvention description.

Generalized Computer Usable Medium

In various alternate embodiments, the present invention may beimplemented as a computer program product for use with a computerizedcomputing system. Those skilled in the art will readily appreciate thatprograms defining the functions defined by the present invention can bewritten in any appropriate programming language and delivered to acomputer in many forms, including but not limited to: (a) informationpermanently stored on non-writeable storage media (e.g., read-onlymemory devices such as ROMs or CD-ROM disks); (b) information alterablystored on writeable storage media (e.g., floppy disks, hard drives, andUSB thumb drives); and/or (c) information conveyed to a computer throughcommunication media, such as a local area network, a telephone network,or a public network such as the Internet. When carrying computerreadable instructions that implement the present invention methods, suchcomputer readable media represent alternate embodiments of the presentinvention.

As generally illustrated herein, the present invention systemembodiments can incorporate a variety of computer readable media thatcomprise computer usable medium having computer readable code meansembodied therein. One skilled in the art will recognize that thesoftware associated with the various processes described herein can beembodied in a wide variety of computer accessible media from which thesoftware is loaded and activated. Pursuant to In re Beauregard, 35USPQ2d 1383 (U.S. Pat. No. 5,710,578), the present invention anticipatesand includes this type of computer readable media within the scope ofthe invention. Pursuant to In re Nuijten, 500 F.3d 1346 (Fed. Cir. 2007)(U.S. patent application Ser. No. 09/211,928), the present inventionscope is limited to computer readable media wherein the media is bothtangible and non-transitory.

CONCLUSION

A tactile touch sensor (TTS) system and method allowing physicalaugmentation of a high-resolution touch sensor array (TSA) has beendisclosed. Physical augmentation is accomplished using a TSA physicaloverlay (TPO) placed on top of the TSA. The TPO is constructed totransmit forces to the underlying TSA. Force transmission isaccomplished by either using a flexible overlay or with a rigidmechanical overlay that transmits user forces exerted on the overlay tothe underlying TSA. Incorporation of TPO identifiers (TPI) within theTPO permits identification of the TPO by a TPO detector (TPD) allowingoperational characteristics of the TSA to be automatically reconfiguredto conform to the currently applied TPO structure by a user computingdevice (UCD). The UCD may be configured to automatically load anappropriate application software driver (ASD) in response to a TPI readby the TPD from the currently applied TPO.

CLAIMS INTERPRETATION

The following rules apply when interpreting the CLAIMS of the presentinvention:

-   -   The CLAIM PREAMBLE should be considered as limiting the scope of        the claimed invention.    -   “WHEREIN” clauses should be considered as limiting the scope of        the claimed invention.    -   “WHEREBY” clauses should be considered as limiting the scope of        the claimed invention.    -   “ADAPTED TO” clauses should be considered as limiting the scope        of the claimed invention.    -   “ADAPTED FOR” clauses should be considered as limiting the scope        of the claimed invention.    -   The term “MEANS” specifically invokes the means-plus-function        claims limitation recited in 35 U.S.C. § 112(f) and such claim        shall be construed to cover the corresponding structure,        material, or acts described in the specification and equivalents        thereof.    -   The phrase “MEANS FOR” specifically invokes the        means-plus-function claims limitation recited in 35 U.S.C. §        112(f) and such claim shall be construed to cover the        corresponding structure, material, or acts described in the        specification and equivalents thereof.    -   The phrase “STEP FOR” specifically invokes the        step-plus-function claims limitation recited in 35 U.S.C. §        112(f) and such claim shall be construed to cover the        corresponding structure, material, or acts described in the        specification and equivalents thereof.    -   The step-plus-function claims limitation recited in 35 U.S.C. §        112(f) shall be construed to cover the corresponding structure,        material, or acts described in the specification and equivalents        thereof ONLY for such claims including the phrases “MEANS FOR”,        “MEANS”, or “STEP FOR”.    -   The phrase “AND/OR” in the context of an expression “X and/or Y”        should be interpreted to define the set of “(X and Y)” in union        with the set “(X or Y)” as interpreted by Ex Parte Gross (USPTO        Patent Trial and Appeal Board, Appeal 2011-004811, Ser. No.        11/565,411, (“‘and/or’ covers embodiments having element A        alone, B alone, or elements A and B taken together”).    -   The claims presented herein are to be interpreted in light of        the specification and drawings presented herein with        sufficiently narrow scope such as to not preempt any abstract        idea.    -   The claims presented herein are to be interpreted in light of        the specification and drawings presented herein with        sufficiently narrow scope such as to not preclude every        application of any idea.    -   The claims presented herein are to be interpreted in light of        the specification and drawings presented herein with        sufficiently narrow scope such as to preclude any basic mental        process that could be performed entirely in the human mind.    -   The claims presented herein are to be interpreted in light of        the specification and drawings presented herein with        sufficiently narrow scope such as to preclude any process that        could be performed entirely by human manual effort.

What is claimed is:
 1. A tactile touch sensor system comprising: anoverlay associated with a functionality and capable of receiving a firstforce; an identifier associated with the overlay; a touch sensor arraycoupled to the overlay and comprising a first sensing element comprisinga force sensing element and a capacitive sensing element and a secondsensing element comprising a force sensing element and a capacitivesensing element configured to detect the first force; and wherein theoverlay is capable of transmitting a first portion associated with thefirst force to the first element and a second portion associated withthe first force to the second element, wherein the first portion and thesecond portion are unequal; and the touch sensor array generates a firsttouch data based on the force.
 2. The tactile touch sensor system ofclaim 1, wherein the first touch data comprises an input for thefunctionality.
 3. The tactile touch sensor system of claim 1, whereinthe functionality is an application program.
 4. The tactile touch sensorsystem of claim 1, wherein the tactile touch sensor system is configuredfor the functionality based on the identifier.
 5. The tactile touchsensor system of claim 1, wherein the overlay includes an indicatorassociated with the identifier.
 6. The tactile touch sensor system ofclaim 1, wherein the indicator comprises one of a group consisting of amagnet, a radio frequency identification (RFID) tag, a dot pattern, araised indicia, an antenna coupled to a microcontroller, an opticalindicia, a shorting bar, a conductive electrode, and a conductive bar.7. The tactile touch sensor system of claim 1, wherein the overlay isdetachably coupled to the touch sensor array.
 8. The tactile touchsensor system of claim 1, wherein the touch sensor array is capable ofgenerating a second touch data based on a second force received on theoverlay in a same user input as the first force.
 9. A method foroperating a tactile touch sensor system comprising: coupling an overlayassociated with a functionality to a touch sensor array; associating anidentifier with the overlay; receiving a first force on the overlay;transmitting a first force from the overlay to the touch sensor array;detecting a first magnitude of a first portion of the first forceapplied at a first portion of the touch area by using a first sensingelement comprising a force sensing element and a capacitive sensingelement; detecting a second magnitude of a second portion of the firstforce applied at a second portion of the touch area by using a secondsensing element comprising a force sensing element and a capacitivesensing element; and generating a first touch data based on the firstforce; wherein the first portion and the second portion are unequal. 10.The method of claim 9, wherein the first touch data comprises an inputfor the functionality.
 11. The method of claim 9, wherein thefunctionality is an application program.
 12. The method of claim 9,further comprising configuring the tactile touch sensor system for thefunctionality based on the identifier.
 13. The method of claim 9,wherein the overlay includes an indicator associated with theidentifier.
 14. The method of claim 9, wherein the indicator identifiercomprises one of a group consisting of a magnet, a radio frequencyidentification (RFID) tag, a dot pattern, a raised indicia, an antennacoupled to a microcontroller, an optical indicia, a shorting bar, aconductive electrode, and a conductive bar.
 15. The method of claim 9,wherein the overlay is detachably coupled to the touch sensor array. 16.The method of claim 9, further comprising generating a second touch databased on a second force received on the overlay in a same user input asthe first force.
 17. An overlay comprising: a first contact location forreceiving a first force; a second contact location for transmitting thefirst force to a touch sensor array; and means for indicating afunctionality associated with the overlay; wherein, the touch sensorarray comprises a first sensing element comprising a force sensingelement and a capacitive sensing element configured to detect a firstportion of the first force and a second sensing element comprising aforce sensing element and a capacitive sensing element configured todetect a second portion of the first force; and the first portion andthe second portion are unequal.
 18. The overlay of claim 17, wherein thefunctionality is an application program.
 19. The overlay of claim 17,wherein the means for indicating is associated with an identifier. 20.The overlay of claim 17, wherein the means for indicating comprises oneof a group consisting of a magnet, a radio frequency identification(RFID) tag, a dot pattern, a raised indicia, an antenna coupled to amicrocontroller, an optical indicia, a shorting bar, a conductiveelectrode, and a conductive bar.